Temperature evolution and bifurcations of metastable states in mean-field spin 
glasses, with connections with structural glasses 
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The correlations of the free-energy landscape of mean-field spin glasses at different temperatures 
are investigated, concentrating on models with a first order freezing transition. Using a "potential 
function" we follow the metastable states of the model in temperature, and discuss the possibility 
of level crossing (which we do not find) and multifurcation (which we find). The dynamics at 
a given temperature starting from an equilibrium configuration at a different temperature is also 
discussed. In presence of multifurcation, we find that the equilibrium is never achieved, leading to 
aging behaviour at slower energy levels than usual aging. The relevance of the observed mechanisms 
for real structural glasses is discussed, and some numerical simulations of a soft sphere model of 
■ glass are presented. 



I. INTRODUCTION 



Free-energy landscapes in high dimensional spaces have longly been used as metaphores for describing the physics 
of complex systems as glasses and spin-glasses, and also proteins and evolutionary fitness landscapes JD. The basic 
idea of this approach is that complex systems dynamics can be viewed as a search for optima in a rough hypersurface. 
Although free-energy surfaces can in principle be defined for large classes of finite dimensional models, the actual 
construction of such functions has been achieved only in the case of long-range disordered system (mean-field spin 
glasses), which relevance for finite dimensional spin glasses has been subject of a long debate, growing evidence 
M pointing in the direction that mean-field theory is a good starting point to describe finite dimensional physics. 
Thouless Anderson and Palmer [3| (TAP) showed that stable and metastable states of long-range spin glasses are 
associated to minima of a suitable free-energy, which is a random function in a A (— > oo) dimensional space. The 
complex phenomenology of equilibrium spin-glasses can be read as a set of propositions about the low lying minima 
£f) , of the TAP free-energy, and the barriers separating them. 

Due to the random character of the TAP free-energy function, analytic statements on the structure of the stationary 
point have forcedly statistical character. Various techniques have been invented to study the minima of TAP free- 
energy, and the structure of the stable and metastable minima for fixed external parameter is known in great detail, 
and gives a coherent picture of the glassy transition. Two classes of models are known, according to the order of the 
freezing transition. In models like the Sherrington-Kirkpatrick models, which display a second order phase transition, 
the metastable states of the TAP free-energy do not play an important physical role. A second order transition 
suggests a mechanism of bifurcation (or rather multifurcation) of the paramagnetic minimum as T c is crossed. In 
off-equilibrium dynamics it is found that all the extensive quantities tend to their equilibrium values for large times. 
Whereas these mean-field models, with continuous transition, seem to apply for the description of real spin glasses, a 
O ■ second class of models, like e.g. the Potts glass, show a first order freezing transition, and seem closer to describing 
the physics of structural glasses. Indeed, for these models occurs a purely dynamical transition where the relaxation 
time diverges, while the static thermodynamic quantities show singularities only at a lower temperature. Below the 
dynamical transition temperature, metastable states dominate the physics, and, dynamically, the extensive quantities 
do not tend to their equilibrium values if a random initial condition is chosen. Statically, the partition function is 
dominated by metastable states (between the statical and the dynamical transitions, by an exponentially large number 
of mutually inaccessible states) that the system is unable to reach dynamically. 

The scenario in which the barriers between metastable states are infinite, and where a quenched system never 
reaches any of these states, is clearly linked to the mean-field approximation. For finite systems, metastable states 
have a finite lifetime, and the system should be able to find them in a finite time. This time, and the states the system 
is able to find, can depend for example on the cooling rate. A modified scenario would include "activated processes" 
and suppress the divergence of relaxation times at the dynamical transition, replacing it by a rapid increase (with 
divergence only at the static transition). 
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This picture, as was already advocated in and more recently in 0, could be relevant for real glasses: indeed, 
the glass transition temperature is also a purely dynamical quantity, defined by the fact that the relaxation time 
reaches a certain value, the existence of a static transition at a lower temperature still being subject of debate. Below 
this temperature, the system remains out of equilibrium for all available time scales, and static quantities are not 
reached. In the same way, the aforementioned scenario would yield a glass transition (corresponding to a large but 
finite value of the relaxation time) occuring above the static transition, and a dynamical evolution resulting from a 
mixture of mean-field like dynamics and activated processes. 

In this context, the relevance of mean- field studies depends on the various time scales involved: if the barriers 
between metastable states are low, activated processes are fast and will dominate the evolution; if on the contrary 
the energy barriers are finite but large, there will exist time windows in which the mean-field scenario will hold. 

To address this question, we have therefore to gain knowledge on the metastable states, both statically and dynam- 
ically, for the mean-field models, and to compare the emerging picture and dynamical scenarios with the real world, 
or at least with numerical simulations. 

If the structure of the TAP minima for fixed temperature is rather well known |8]|| , a much less coherent picture is 
available for the correlation of the free-energy landscapes for different temperatures. In the Shcrrington-Kirkpatrick 
model, the study of [ p^|JTl| ] have revealed "chaotic temperature dependence" of the low lying states. States of equi- 
librium at different temperatures are, no matter how small the temperature differences, as uncorrelated as they can. 
In some other models the chaotic property is absent. A clear example is the spherical p-spin model, where the ho- 
mogeneity of the Hamiltonian implies that the order of the free-energy minima does not depend on temperature, so 
that, in the whole low-temperature phase, the statics is given by the same low-lying states. Some general conclusions 
about the fate of TAP minima under temperature changes can be drawn on the basis of smoothness of the TAP 
free-energy as a function of temperature. For example, absolutely stable minima can not disappear or multifurcate for 
an infinitesimal change of the temperature, and the generation of new stationary points has to pass by a marginally 
stable situation. 

Two issues appear to be relevant for the description of correlations of the landscapes for different temperatures: 
level bifurcations and level crossing. Therefore, in this paper we try to gain some generic insights on these topics, 
by addressing the issue of following the TAP states in temperature for a spherical model which displays first order 
glassy transition. Differently from the p-spin model, the Hamiltonian is not homogeneous. We expect therefore that 
its behavior is generic in the class of models with first order transition. The analysis is performed with the aid of a 
recent method where the metastable states are associated to local minima of some macroscopic "potential" function 
of the spin-glass order parameter. The basic idea of this approach is that the free-energy manifold can be probed 
introducing an external field pointing in the direction of some typical equilibrium configuration [jl2|-[l4[ . In section 
two, we review the construction of the potential of ref. [ p2[ and extend the discussion to some properties not mentioned 
there. In section three we use this potential to follow metastable states in temperature, and discuss the possibility of 
multifurcation. 

In section four, we use another powerful approach, a dynamical one, with appropriate initial conditions: the 
dynamics of a system thermalized at a certain temperature, and then brought at another, also allows to explore 
the phase space of the system |l^,[lf|. We show that the two methods yield the same results, and use moreover 
this dynamical study to tackle another relevant issue: the dynamical behavior of the systems when a TAP solution 
bifurcates. In particular the problem whether the system will fall into one of the new valleys or will be unable to 
decide where to fall and age forever. 

After having described these mechanisms for the considered mean-field models, we tentatively compare them in 
section five to the case of real glasses, via numerical simulations of a soft sphere glass. In particular, the dynamical 
mean-field approach of thermalized initial conditions can be thought of as a previous very slow cooling to a certain 
temperature, followed by a rapid change. The study of the energy reached with various cooling rates in the simulated 
system shows the relevance of the mean-field scenario, in the available time window. 

II. STUDIED MODELS; THE POTENTIAL; PREVIOUS RESULTS 

The class of models we consider is defined by N (real) spins s = {si, ■ ■ ■ , sjv} interacting through a Hamiltonian 
H(s) and a global (spherical) constraint ^2,, sf = N. The Hamiltonian is random, Gaussian, with correlations 

H(s)H(s>) = Nf(q ss> ), (1) 

where q ss i = ^/N'^2 i Sis' i is the overlap between the configurations s and s'. If / is a polynomial function, the 
Hamiltonian can be presented as a linear combination of terms of the type 
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Hp(s) — ^ t Jiii2---i P s ii s i2 ' ' ' S » P ' (2) 

l<'il<i2---<i P <A r 

with Gaussian independent couplings Ji^—ip, with zero mean and variance p\/(2N p ~ v ). It is easy to see that 

Hp(s)H P '(s') — <5p,p'C?s S '/2. As we will see in the following, the purely monomial case, the so called p-spin model, 
has remarkably simple properties under temperature changes |j| thanks to the homogeneity of the Hamiltonian under 
contemporary rescaling of all the variables. In order to study the generic behavior it is therefore necessary to consider 
inhomogeneous Hamiltonian, giving rise to non monomial correlation functions. The specific form of the function f(q) 
we will use in our examples will be mainly f(q) = l/2(q 3 + q 4 ), however the results will be generic for inhomogeneous 
Hamiltonian verifying the condition that f"(q)~ 3 / 2 f'"(q) is monotonically decreasing with q for all q (this ensures 
that the transition is a discontinuous one). 

In that case the statics of the model is described by 

• a high temperature phase, for T > Td, where the dominant contribution is given by a paramagnetic state; 

• a temperature range Td > T > T s where the replica calculations yield a replica symmetric result, which in fact 
corresponds to ergodicity breaking in an exponentially large number of states (finite complexity); 

• a low temperature phase, for T s > T, with a 1-step replica symmetry breaking, corresponding to the predomi- 
nance of the lowest TAP states, with zero complexity. 

The relaxation dynamics from a random initial state, yields equilibrium dynamics in the paramagnetic state for 
T > Td, while, for Td > T, the aging phenomena appears |16| and the long time limit of the energy per spin is higher 
than the equilibrium value. 

In this section we review the construction of the potential function fl^| , and we expose some new results coming 
from a replica symmetry breaking Ansatz, which clarify some of the "mysteries" left open in J12[. 



A. Construction of the potential 



One of the characteristics of spin glasses, due to their random character, is that the different equilibrium states 
can not be selected by an external field uncorrelated with the landscape defined by the Hamiltonian. The basic 
idea underlyingthc potential function is to use an external field pointing in the direction of a particular equilibrium 
configuration |]l^,^2|. So, if <jj denotes a typical equilibrium configuration at a temperature T' one can define the 
partition function 



Z[T,e,a] = J2e~ f " il ° l+e °" T - (3) 
s 

Besides being self- averaging with respect to the distribution of the quenched Hamiltonian, the free-energy T[T, T", e] = 
—T/N log Z[T, e, a] is also independent on the particular configuration a we choose, and therefore coincide with its 
average over the probability distribution exp(— (3'H[cr])/Z[T']. We define the "potential" as the Legendre transform 
of T: 

V[T,T',q 12 ]=zmnT[T,T',e] + eq 12 -F[T}. (4) 

e 

From the Legendre transform we have subtracted F the free-energy at temperature T in order to have V[T, T', 0] = 0. 
Defined in this way, the potential has the meaning of the free-energy cost to keep a system at temperature T at fixed 
overlap q±2 from a generic configuration of equilibrium at a different temperature T". 

V is self-averaging also with respect to the quenched disorder distribution, which we denote by an overline. The 
basic object we need to evaluate is then 



^l^e-^Mlog 



-0H[S]+eS-a ^ (5) 



As it is explained in detail in [ fl2[ , in order to perform the averages it is possible to use a double analytic continuation 
from integer values of the parameters m and n, used to represent log Z[T, e, a] as lim m _>o (Z[T, e, <j] m — l)/m, and 
l/Z[T'] as lim„^o Z n ~ x . There are then n replicas a a (a — 1, n), and m replicas S a (a = 1, ...,m). The "external 
field" terms is an interaction term of all the replicas S a with one privileged replica, say, a\ . Three overlap matrices 
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turn out to be relevant for the description of the physics of the model: Q* ab — ^X)i( cr f cr i) describing the overlap 
statistics of the replicas at equilibrium at temperature T', P a , a — jfY^ii 17 ?^?) describing the overlaps among the 
replicas at temperature T' and the replicas at temperature T, and finally Q al3 — Sf ) describing the overlaps 

between replicas at temperature T. As is physically clear, it is found that the structure of the matrix Q* ab is not affected 
at the leading order by the presence of the replicas S a . In this paper we will restrict ourselves to the temperature 
range T > Ts, where Q* ab = S a b- In this regime it is sensible to assume P a . a = b a ,\<hi for all a. The structure of 
the matrix Q a p is more subtle. Assuming a single state picture in ref. [Q the form Q a p — S a p + q(l — dap) was 
taken. But it turns out also to be necessary to consider the possibility that ergodicity is broken for the system in a 
"field" , with consequent replica symmetry breaking in Q a p. The most general Ansatz we shall need is the "one step" 
form (see e.g. 0), characterized by the parameters (qo,qi,x). With this Ansatz it easy to find that the potential as 
a function of all the order parameters is: 



V(qu) = ~ {2/3/37(912) ~ P 2 ((1 - x)f( Ql ) + xf(q )) + ^ln(l - <?l) 

+ -ln (1 - (1 - x)q x - xq ) + - f 12 

x 1 — (1 — x)qi — xqo 

where V has to be maximized with respect to go, 9i an d x - These saddle point equations read: 



(6) 



q 2 l2 =10- P 2 f'(qo)(l - (1 - x) qi - xq ) 2 
P 2 (f'(qi)-f(qo))(l-x) = (l-x) 



qi - qa 



(1 - q%)(l - (1 - x)q 1 - xq ) ' 



P 2 (f(qi)-f(qo)) + \\n 



1 



qi 



1 - (1 - x)qx - xq 



2O--I1) ,, 



(1 - (1 - x)qi - xq ) = 0. 



(7) 



A numerical resolution allows to construct the curve V(qi2) []. 

In general, this curve can be divided in three regions. There are a small and a large qi2 regions (outside the interval 
A — B in figure 1) where replica symmetry holds. In between the symmetry is broken. In the large q 12 region, the 
solution is q\ = qo testifying ergodicity in a single state. In the point B a de Almeida Thouless instability develops. 
The replica symmetry breaking region is interpreted as usual ergodicity breaking with dominance of small number 
of valleys for typical samples. In the point A one finds x = 1, and the restoring of replica symmetry implies in 
fact a number of valleys exponentially large Af ~ e Ars (9i2)_ j n tins region (between qi2 = and A), x = 1, the 
Edwards- Anderson parameter inside the valleys is obtained as the value of qi from the second equation of (]?]) divided 
by (1 — x) in x = 1, and is depicted with crosses in figure (^). The complexity E(gi2) can be calculated as in the usual 
case as ^\ x =i, and is depicted in figure (|^). For qi2 — 0, where there is no effective constraint, the second replica 
is at equilibrium at T and we find the total complexity at temperature T, and the equilibrium Edwards-Anderson 
parameter at T. 

The global situation is displayed for a typical example in figures (|l]) and (||). 




x In [jfj]], the form Q a /3 = 8 a p + q(l — Sap) yielded simplified equations, corresponding to go 
will be denoted as "replica symmetric" potential. 



qi m 



([?]) . The resulting potential 
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FIG. 1. Potential V as a function of gi2, for the p = 3 + p — 4, /3 = 1.25, /3' = 1.243; full line: replica symmetric solution; 
dotted line: RSB solution, from A (x = 1) to B (where go and gi merge) 



q0,q1 

0.8 




FIG. 2. qo(qi2), gi(gi2_) as a function of gi2, for the p = 3 + p — 4, (5 — 1.25, /3' = 1.243 (lines); diamonds: RS solution, given 
by inserting go = gi in (0); crosses: continuation of 51(912) in the first RS region, with lim 912 ^o 91(512) = <Iea(P) 



0.02 




FIG. 3. 2(912) for the p — 3 + p — 4, (3 = 1.25, /?' = 1.243; for gi2 — » we recover the complexity at ft. In A the complexity 
goes to zero, corresponding to the entrance in the RSB region of the potential. 

B. Minima of the potential 

The qualitative features of the potential are largely independent of the form of the function /. Let us briefly discuss 
the case of equal temperatures ft = ft 1 [fL2[ . The potential has always an absolute minimum for 912 = 0, corresponding, 
as previously mentioned, to the second replica being at equilibrium. Another minimum appears for a non-zero value 
of 912 for temperatures below Td (see figure (^)) (at T — T' — T c i, it is a horizontal flex). This relative minimum 
corresponds to having both replicas in the same state, with 912 = 9 = qEA- Since the number of equilibrium states at 
temperature T is exp(A r E(T)) by definition of the complexity (or configurational entropy) S, the free energy cost of 
having this situation is 

Vrelative minimum {QEA ) = TE(T) = —^rf(qEA) — ~7T7r ~ T7a^ n (^ ~ QEa)- (8) 
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FIG. 4. Potential V as a function of qi2, for the p — 3 p-spin model, for /3 = /3', from top to bottom f3 = 1.6, f3 — fid ~ 1.633, 
/3 = 1.7; here /3 S = 1.706 

For the p-spin model, the case of different temperatures (3 and /?', has also be treated in some details fl2fl . The 
relative minimum, which still exists for < T < Tfi na i(T'), and T' < Td, remains in the replica symmetric region of 
the potential, and can be clearly interpreted. Indeed, the homogeneity of the Hamiltonian allows to write the TAP 
free energy in a simple form P, p^ , |l8| , |l5[ : 



fTAPttm}) = q%E°({s t }) - |ln(l -q)-±[(p- - pqP^ + 1] ; 

where we have written n%i = (si) = y/qs.i, with sf = N, and the angular energy (zero-temperature energy) is 

1 



E°({h}) 



N 



E 



(9) 



(10) 



l<il < - <i p <N 



The order in free energy of the solutions of the TAP equations does not depend on temperature, nor a solution 
can bifurcate as the temperature is changed. All these solutions can be easily parameterized |p|, p^| , ^8|JT5| ] and followed 
with temperature. 

It is then easy to show that the properties of the primary minimum (value of qo = Qi, and energy) are precisely 
the properties of the TAP states of equilibrium at T" (characterized by a zero temperature energy E' ) followed at T 
(parameter q and energy), with 



Vprimary 



= TE(T') + F TAP (T, E' ) - F(T) 



(11) 



These situation corresponds therefore to having the second replica in a TAP state of equilibrium at T" followed at 
T These situation was also ascertained by the study of the dynamics of a system thermalized at T', and whose 
temperature was then changed to T |]l^ , |l5| , [l9[ : the dynamics obtained is indeed of equilibrium in these particular 
TAP states, chosen by the thermalization at T' and followed when the temperature of the system is changed. 

In the case of / different from a monomial, i.e. of an inhomogeneous Hamiltonian, many points remained unclear. 
In particular, the TAP free energy cannot be parameterized in such a simple form, and it is not granted that the TAP 
solutions keep their order in free energy when the temperature changes. Moreover, the role of the breaking of replica 
symmetry was not studied. In the p-spin model, as a consequence of the absence of bifurcation of the solutions, the 
minimum of the potential is always in the replica-symmetric region, and the inclusion of replica symmetry breaking 
effects does not affect the discussion of the metastable states, except for eliminating the spurious secondary minimum 
found in |13], which meaning was not clear. 

For an inhomogeneous Hamiltonian, by studying the potential, including RSB effects, and the dynamics with 
thermalized initial conditions, we will show that the potential still allows to determine the characteristics of TAP 
states, as long as the minimum is in the replica symmetric region. We will associate the entrance of the minimum in 
the RSB region of the potential with bifurcations, and show that, in this case, the dynamics with thermalized initial 
conditions gives rise to a particular form of aging. 



2 Let us also note that, for j3' = j3 dj the minimum becomes in fact a horizontal flex of the potential, with energy and parameter 
qi2 equal to those obtained in off-equilibrium dynamics. 
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III. POTENTIAL FOR AN INHOMOGENEOUS HAMILTONIAN 



Let us turn to the detailed study of the potential in the case of an inhomogeneous Hamiltonian. The numerical 
examples will be given for f(q) = (q 3, + q 4 )/2 for simplicity, but the analysis is independent of this particular form. 

We first note that, like for the homogeneous case, a minimum with qi2 ^ only exists for T' < Td- Moreover, we 
will limit us to T' > T s . For T — T' , the primary minimum is still in the replica symmetric part of the potential. If 
T is raised, this minimum stays in the RS region, and disappears at a certain temperature Tjj na ;(T'), which verifies 

Tfinal{Td) — Td- 

As T is lowered however, the endpoint of the RSB region (where qo = q\ = q) gets closer to the minimum, and 
finally reaches it at T rsb (T') = -J— given by 

Prsb 



f3 2 rsb f"(q)(l-qf = l 
P 



PrsbP'f'iP) 



1 



(12) 



where p is the value of qi2 in the minimum. For even lower temperatures, the minimum is within the RSB region. 
T rsb {T') reaches zero for some V (see figure (§)); for lower T", the minimum is always in the RS region. 




0.78 

~3 , 



FIG. 5. T f inai(T') (full line) and T rsb (T') (dashes) for /(<?) = l/2(g a + q 1 ); T d » 0.805166. Note that at low enough 
temperature, the states never bifurcate. The vertical line corresponds to X" = Td, i.e. the temperature of appearance of the 
minimum: along this line the potential displays an horizontal flex. 



An example of the situation T > T rsb (T') is displayed in figure (|l|), while the limiting case T — T rsb {T') and a case 
where T < T rsb (T') are shown in figure (^J). 



FIG. 6. Potential for p = 3 +p = 4, for = 1.243 and (3 = 1.4625 (left), (3 = 3 (right); full lines=RS solution , dashes=RSB 
solution. For /3 — 1.4625 the endpoint of the RSB solution coincides with the minimum of the potential; for /3 = 3 the minimum 
has disappeared from the RS solution, while it still exists for the RSB curve 
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For temperatures Tfi na i(T') > T > T rs },(T') the primary minimum can be interpreted as the state of equilibrium 
at temperature T' followed down at temperature T. Indeed, if we consider the TAP states with values of the energy 
and of the parameter q equal to those of the primary minimum, and if we compute their free energy /tap, we obtain 
(see appendix): 

Vprimary = JtAP ~ F R s(T). (13) 

Following the computation of |2(]|l8| , it is also possible to obtain the number of TAP solutions with fixed parameter 
q and energy Etap, and, writing it in the form 

exp(NS(q,ET AP) T)) (14) 

we have checked numerically the identity: 

S(q pr ,E primarv ,T) = j:(T r ). (15) 

Therefore, the number of equilibrium TAP solutions at T" (exp(iVE(T"))) is equal to the number of TAP solutions at 
T with the energy and the parameter q of the primary minimum. This fact, together with (|l3|), shows that the state 
of equilibrium at T' has been followed at T, and is a stable state with free energy cost 

y primary = TE(T') + F T Ap(Eprimary , , (3) ~ F RS (T) ■ (16) 

(where the total, i.e. with the complexity term, free energy of the TAP states is Ftap(Etap, Q, (3) = 
fTAp(ErAP, Qi P) — TS(q, Etap, T)). We will show in next section how these states can be followed dynamically, by 
choosing appropriate initial conditions. 

For T < T rs b(T') on the contrary, the primary minimum is in the region of the potential which displays replica 
symmetry breaking ^. The obvious interpretation for this is that at T rs },(T'), the metastable states multifurcate, 
according to the usual pattern known from the physics of the Sherrington-Kirkpatrick model. 

Let us now address the problem of level crossing: the p-spin model seems very particular, in that the order in free 
energy of the TAP states does not depend on temperature. For T < T s , the statics are given by the lowest TAP 
states, therefore there are high correlations between equilibrium states at different temperatures. On the other hand, 
for temperatures between T s and Td, equilibrium measures at different temperatures are given by different bunches of 
TAP states; therefore the overlap between equilibrium states at different temperatures is zero, but the TAP states can 
be followed at other temperatures, and their order in free energy (without the complexity term) remains the same. 

For the case of an inhomogeneous Hamiltonian, we also show that, as long as we consider TAP states giving the 
equilibrium measure at temperatures higher than T s , we have no crossing in the free energies /tap- indeed, if we 
note f(T, T') the free energy of one TAP state of equilibrium at T", followed at T, we have 

f(T,T ) — Vprimary 

(T,T')+F{T), (17) 

and thus we obtain 

^/(r,T0 = ^p. (18) 

This quantity is always positive, so, if we have two temperatures Td > T[ > T' 2 > T s , at any temperature T for which 
we can follow the states giving equilibrium at T[ and T' 2l the order 

f(T,T{)>f(T,r 2 ) (19) 

is conserved. Of course, this is not the case if we consider the full free energy, with the complexity term, i.e. 
F(T, T 1 ) = f(T, T') - TE(T'). We then have that each curve F(T, T') as a function of T is tangent to the curve 
F RS (T) at the point (T',F(T',T) = F RS (T')). 



3 Note that T rs b(Td) = Td, and that, for T' = Td, T < Td, the minimum is in fact an horizontal flex, like for the homogeneous 
case, except that it lies within the RSB region of the potential. Besides, the energy in this point is equal to the dynamical 
energy at T. 
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Hence, this global situation, with the replica symmetric free energy as the envelope of the curves giving the total 
TAP free energies, whereas the curves giving the TAP free energies without the complexity term do not cross, seems 
very generic between the static and dynamic transitions. 



. Total free energy 



F(T,Tj ) 

FfT.r) 




Temperature 

TJ T' 2 

FIG. 7. Total free energy 

Considering the case of T' — T s , the lowest T 1 for which we are allowed to use the simple Ansatz Q* ah = 5 a b, we 
find a different situation. In fact, we find that if T < T s the value of the potential in the primary minimum is slightly 
higher than 0, with qea{T) = <?i (Q12 - * 0) > q pr > q^- This is in contrast with the case of the p-spin model, for which 
the states of equilibrium at T s , followed at T, are still of equilibrium at T: these are the lowest TAP states, and they 
dominate the equilibrium measure for temperatures ranging from to T s . In this case we obtain V pr i mary = V(0), 
and q pr = qi(qi2 — > 0). Here on the contrary, the difference between the quantities at q±2 — and at the primary 
minimum show that the states of equilibrium at T s are no more of equilibrium at T < T s . Therefore, there is presence 
of chaos in temperature. For a detailed study of the T' < T s region, we would however need to take into account the 
RSB effects on the first replica, which would yield another form for the potential, and we will not do it here. 



IV. DYNAMICS 



We now address the problem of the dynamics of the system at T, starting from thermalized initial conditions at T". 
In the case of the p-spin model, it was shown that such a procedure allows to reach dynamically the states described by 
the minimum of the potential, i.e. to follow dynamically the TAP states. As usual, we study the Langevin relaxation 
dynamics of the model, given by 

at osi 

where the rji are Gaussian thermal noises with {r]i{t)rjj{t')) = 2T5ijS(t — t'), and /i(t) has to be computed self 
consistently in order to implement the spherical constraint sf = N. 

In the infinite N limit, we can obtain the dynamical equations for the correlation and response functions (C(t, t') = 

jf WO), r{t, t>) = i Ei(^)) @H> that for t > t' read : 

^f>- = - f i(t)r(t, t>) + J ds f"(C(t, s))r(t, s)r(s, t') 
dC(t, t' 



= -M(*)C(t,f)+ / ds f(C(t,s))r(t',s) 



+ J* ds f"(C(t, s))r(t, s)C(s, f ) + ±jf(C(t, 0)) C(t', 0). (21) 
complemented by the equation that enforces the spherical condition 

H{t)= f ds f'(C(t,s))r(t,s)+ f ds f"(C(t,s))r(t,s)C(s,t) 
Jo Jo 

+ T+±jf'(C(t,0))C(t,0) (22) 







In |12fl . it was noted that a numerical integration of ( KjJ ) for a particular choice of the temperatures, after some 
transient led to equilibrium with time translation invariance (TTI) and validity of the fluctuation dissipation theorem 
(FDT). However, no systematic study was undertaken. 

As long as the primary minimum of the potential is in the replica symmetric region it is reasonable to take as an 
Ansatz that indeed an equilibrium regime is reached after a short transient. We therefore deal with the functions 
C as (r), r os (r) related by FDT, with the introduction of the limiting quantities p and q: 

C{t,t') = C as (t-t'); r(t,i/)=r as {t-t');r as {T) = -p-^C as (T) 

lim C(t, 0) = p- lim C as (r) = q (23) 



This Ansatz yields the same equations for p and q as the ones for qi 2 and q (|A2|) specifying the extremum of the 
potential in the RS region [jl2[ . Besides, it coincides very well with the results of a numerical integration of equations 
(pl|). We can therefore conclude that the dynamics takes place in a TAP state, of equilibrium at T', in which the 
system was put by thermalization at T", followed dynamically at the new temperature T. This behavior is exactly 
the same as for the p-spin model [ fl5| . 

For T < T rs f,(T') another Ansatz has to be chosen. In particular, since for low enough T the minimum disappears 
from the RS potential, the dynamical equations for p and q have no more solutions. We therefore propose an Ansatz 
similar to the one used in the aging dynamics of such models [ ft6[ , except that the motion will be confined in the 
vicinity of the initial state. We assume then that: 

• for finite time separations r = t — t' ', with r/t going to zero, the equilibrium properties are valid, which means 
that we deal with the functions Cfdt{t) and vfdt(t), related by FDT. We note lim r _»oo Cfdt(t) = qi- 

• an aging regime is present: for t and t' going to infinity, without (t — t')/t — > 0, time translation invariance is 
violated, and the FDT is replaced by the quasi-FDT 

with constant 1. In this regime, we have the limits lim t y 4 _>i C(t,i') = q±, lim t // 4 ^ C(i, t') = q^. 

• we have moreover to introduce the quantity limt^oo C'(t, 0) = p, which tells how much the system remembers 
its initial conditions. 

As it happens in the random initial condition case, the parameters q\,qo,p,x can be determined from the asymptotic 
analysis of equation ( pTl) without fully solving the dynamics. The hypothesis of existence of an aging regime, and the 
continuity of the response function implies the equation 

/3 2 f"( qi )(l- qi ) 2 = l (25) 

which coincides with the "marginal stability condition" of the statics [^3],|l6| . The other three equations 

= /3/'(<Zi)(l - qi) + 0x( qi f( qi ) - q f(q )) + 0pf'(p) 
= {3px(f'(q i )-f'(qo))+{3'f'(p) 

- /3/'(«o)(l - Qi) + Mf'(qi) - f'(qo)) + P'pf'(p), (26) 

can be shown to be equivalent the vanishing of the derivatives of the potential function (|J) with respect to q\ , qo and 
qi2- In terms of these parameters the asymptotic energy is given by: 

E = -f3'f(p) - (3(f(l) - f( qi )) ~ (3x(f( qi ) - /(«,)). (27) 

The usual aging behavior with qo = p = is of course solution of these equations. This corresponds to forgetting the 
initial conditions, and happens when T' is higher than the dynamical transition temperature. However, for T' < T4, 
this solution, besides of contrasting with the statical picture of the model, would be internally contradictory: indeed, 
at T rs b the energy in the primary minimum is lower than the dynamical energy at the same temperature. Therefore, 
such a solution, which would yield an asymptotic energy equal to the dynamical one, would lead to a higher energy 
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for a lower temperature! Finally, the numerical integration of the dynamical equations shows that the behavior of the 
dynamical quantities is very different from the case of infinite T', and that C(t, 0) does not seem to decrease to zero. 
This facts lead to the conclusion that we must prefer the solution with non-zero qo and p. The aging takes therefore 
place in a restricted phase space region. However, for T < T rs b(T') the dynamic internal energy is higher then the 
static one, similarly to what happens starting from random initial conditions. 

Let us also note that the asymptotic energy ( ^7|) in the case of thermalized initial conditions is lower than the 
dynamical energy after a quench, showing that this procedure allows to reach states with lower energies. An immediate 
consequence is the importance of the way in which the final temperature is reached. 

V. A COMPARISON WITH REAL GLASSES 
A. General considerations 

In the studied mean- field models, we have found that, below the dynamical transition Tp>, we could define a whole 
spectrum of internal energies for the system at temperature T, depending on the way the system has been put at its 
final temperature: 

• the equilibrium energy E eq (T), which is done by the usual Boltzmann Gibbs formula; 

• the dynamical energy, corresponding to the energy of a system which is quenched to the final temperature from 
a temperature higher than To; 

• the energies E(T',T), obtained for a system at equilibrium at T' and then put at T. Depending on T' and T, 
the system can be at equilibrium or exhibit aging dynamics. 

These energies can be consistently computed using the explicit form of the dynamics. It is also possible to compute 
them by using the appropriate statistical prescription which does not make explicite reference to the dynamics. 

At this point the reader may ask how much all these findings are relevant for the real world. Metastable states with 
infinite life do not exist in short range finite dimensional models and their presence in mean field models is a clear 
artefact of the approximation. The would be infinite life metastable states of the mean field theory do decay through 
some activated processes (whose detailed properties have not yet been fully clarified). If the mean field picture is 
relevant for the real word the time scale of the activated processes should be large enough that there is a time window 
in which the behavior predicted by mean field theory can be observed. 

Given our lack of command on the activated processes, we cannot treat this question analytically and we have to 
resort to numerical simulations. We will consider a simple system, one of the prototypes of glass forming systems, 
known to have a glass transition at a given temperature Tq. 

We will see that we can also define various energies: 

• the equilibrium energy E eq (T); 

• the slow cooling energy Eg(T), which is obtained by the limit to infinite cooling time of the energy of a system 
which starts at temperatures greater than the dynamical transition; 

• the fast cooling energy Ep(T), which is obtained by the limit to infinite cooling rate of the energy of a system 
which is quenched to the final temperature from a temperature higher than Tp>. 

Between Es(T) and Ep(T) 7 various cooling rates will yield various asymptotic energies. 

We will see that if we fast cool the system to a temperature near of below Tq (we have investigated up to temper- 
atures equal to .25Tq) the energy as function of the time may be represented by the following form 

E F (t) = Ep + Ar" + 0(t~ 2 "), (28) 

where the exponent fi is in the range .5 — .7 and weakly depends on the temperature. The previous formula well 
represent the data for time in the window 10 2 — 10 5 time units (i.e. one Monte Carlo sweep). 

In the similar way we can represent the data for the slow cooled energy as function of time with a similar form in 
the same time window: 

E s (t) = E s + At->* + 0(t- 2 »), (29) 
where the exponent /i is compatible to be equal to the one used in equation (p8f). 
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The two functions Ep and E$ are different one from the other below Tq and their difference vanishes when we 
approach Tq. It is clear that the two previous formulae can be valid only in a limited time window; asymptotically 
the two energies Ep(t) and Eg{t) must go to the same limit, (i.e. the equilibrium value of the energy). This is likely 
to happens on a much longer scale. Here we want to stress the presence of a time window in which the prediction of 
a theory based on the existence of metastable states can be tested. 

Before showing the results of the numerical simulations, we will give some details of the model we consider. 



B. The Hamiltonian 



The model we consider is the following. We have taken a mixture of soft particles of different sizes. Half of the 
particles are of type A, half of type B and the interaction among the particle is given by the Hamiltonian: 

^Eft^f. (») 



i<k 



Xi - Xfc 



where the radius (tr) depends on the type of particles. This model has been carefully studied in the past |24|-|29||. It is 
known that a choice of the radius such that <jb/&a = 1-2 strongly inhibits crystallisation and that the systems goes 
into a glassy phase when it is cooled. Using the same conventions as the previous investigators we consider particles 
of average diameter 1, more precisely we set 

o\ + 2{a A + a B f + al = i ^ 

Due to the simple scaling behaviour of the potential, the thermodynamic quantities depend only on the quantity 
T* / p, T and p being respectively the temperature and the density. For definiteness we have taken p = 1. It is usual 
to introduce the quantity T 4 = (3. The glass transition is known to happen around V = 1.45 (i.e. for T k, 0.226) [Bp. 



C. Numerical results 



Our simulation are done using a Monte Carlo algorithm, which is more easy to deal with than molecular dynamics, 
if we change the temperature in an abrupt way. Each particle is shifted by a random amount at each step, and the 
size of the shift is fixed by the condition that the average acceptance rate of the proposal change is about .4. Particles 
are placed in a cubic box with periodic boundary conditions. In our simulations we have considered a relatively small 
number of particles i.e. N = 66. Note that for all the simulations, the system is always out of equilibrium and exhibits 
aging: the ergodic time is far beyond reach p7| , p8|j30| . 

We start by placing the particles at random and we quench the system by putting it at its final temperature (i.e. 
infinite cooling rate). The typical value of the energy density of the initial configuration is very high (O(10 5 )) due 
to the singular form of the potential and it takes a few iterations to arrive to a more reasonable value. We show the 
data as function of the Monte Carlo time t in figure (||) for T = 1.8 (T « 0.095). 

In the slow cooling approach we also start by placing the particles at random at the beginning. We divide the 
cooling time in 5 equal intervals: in the first interval we have T = 1, in the second interval T — 1.2,... and the fifth 
interval T — 1.8. The data are taken for each temperature only in the second half of the corresponding interval. 
The results as function of the time spent at each temperature, i.e. of the inverse of the cooling rate, are shown in 
figure (||) for T — 1.8. We clearly see that the two curves Ep and E$ definitely extrapolate to a different value. The 
extrapolated values of the energy as function of the temperature can be seen in figure ( |l0| ) using the fast and the 
slow cooling method in the region T > 1.4 (T < 0.26). The data are not shown at higher temperatures, because 
the two methods give the same result. Other procedures to investigate the dependence of the cooling rate involve a 
similar cooling from T = 1 to T = 1.8 in a total time t coo ii ng , with times t coo ii ng /A spent at T = 1., 1.2, 1.4, 1.6, 
and then the study of the evolution of the energy at T — 1.8. The long time limit of the energy lies then between 
Ep (for t coo iing — * 0) and E$ (for t coo iing — * oo). We show in figure (g) the evolution of the energy at T = 1.8 for 
various cooling rates. The effects are quite small, so it is necessary to compare reasonably different rates. For the 
available times, the energy of the system depends on the cooling it has followed: the energy is lower for slower cooling 
procedures. 

Moreover, it is worth noting that the value of p is roughly speaking independent from the temperature ]3Q] . This 
phenomenon happens in the only model of mean field theory where the exponent has been computed [ |3l| and this 
is a strong indication that the approach to equilibrium in this region is not dominated by activated processes, but 
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more (roughly s pea king) by entropic barriers: the barriers between metastable states could include both energetic and 
entropic effects |32|| . Moreover, this shows the possible relevance of the scenario detailed in the preceeding paragraph 
(aging similar to usual, but at lower energies), and of some intuitive mean-field scenarios plfl . 

It would be interesting to be able to simulate the thermalization at a certain temperature, followed by a quench at 
a lower temperature, like in mean-field models. Unfortunately, the available time window do not allow us to reach 
thermalization at temperatures lower than the dynamic transition. 

Another possibility would be to cool very slowly the system to a certain value T", such that its energy is lower than 
Es(T) for a certain T (T > T'), and then to bring the system back to T, to see whether the obtained energy is still 
lower than E$ (T) . Such investigations are however beyond the scope of the present short study. 




0.01 0.02 0.03 0.04 0.05 0.06 0.07 

t«(-.5) 

FIG. 8. "fast" curve: energy as a function of t~' 5 where t is the time spent at F — 1.8 after a rapid quench; "slow" curve: 
energy reached at the end of the time spent at F = 1.8, as a function of of t~' , where t is the time spent at each temperature 
during the gradual quench process. We see that slower cooling yields lower energies. The continuation to t~' 5 —* corresponds 
to an infinitely slow cooling. 




1.9 1 ' ' 1 1 1 

0.01 0.02 0.03 0.04 0.05 

t«(-.5) 

FIG. 9. Evolution of the energy at F = 1.8 (T ~ 0.095), in function of time, for various cooling rates; the horizontal lines 
correspond to Ep and E$- The lower curves correspond to slower coolings. 
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FIG. 10. Extrapolations of the energies Ef and Es at large times, i.e. asymptotic energies after a quench or after an infinitely 
slow cooling, for various temperatures. 



VI. SUMMARY AND CONCLUSIONS 



In this paper we have investigated the behavior in temperature of the metastable states of long range spin-glasses 
with first order freezing transition. We have shown that the metastable states can be followed up and down in 
temperature, from the temperature where they are dominating the partition function. Going up in temperature, 
one finds some temperature where the states disappear, merging with some maxima. Going down in temperature, 
the state do never disappear, although in some range of T" multifurcation is found. We also studied the dynamics 
at temperature T < Td, following a quench from equilibrium at temperature T' . If T' > Td we find no difference 
from the usual aging behavior pq | that follows a quench from infinite temperature. For T 1 < Td we have found two 
possibilities. If T > T rs b(T') the original valley has "deformed" but not bifurcated and the system is able to equilibrate 
inside it. In the complementary interval T < T rs b(T') the landscape has changed drastically as the original valley has 
bifurcated. The system is then unable to thermalize and falls in an aging regime, while remaining confined in the 
vicinity of the initial data. Besides, this dynamical study shows that the aging after a slow quench (in the mean-field 
case, the case of thermalized initial conditions at T' can be thought of as a situation after an infinitely slow quench) 
allows to reach a situation where the behavior is qualitatively similar to the one after a rapid quench (i.e. aging 
corresponding to a slow touring of the phase space), but within a phase space region with lower energies. Therefore, 
at a given temperature T, the possibilities are not only of aging at a relatively high energy, after a sudden quench, or 
of equilibrium dynamics after an infinitely slow quench, but also of aging at intermediate energies, depending on the 
route from high temperature to T. 

In the last section, we tried to emphasize the possible relevance of such mean-field scenarios for finite dimensions, 
where it has been advocated that metastable states may still exist, but with a finite lifetime: coming from a high 
temperature phase, the system may be able to find these states in a finite time, and the resulting aging behavior 
when decreasing the temperature could be a mixture of jumps between states and periods of wandering when states 
bifurcate. 

Indeed, the numerical study of section V shows indications that, at least in the explored time window, for a soft 
sphere model of glass exhibiting aging, the dynamics is not dominated by activated processes. Depending on the 
cooling rate from the high temperature phase, various energies can be reached. Since the system is finite, it should 
however reach equilibrium in a finite time (the energy should reach the equilibrium energy, whatever may be the route 
to the final temperature) but, these simulations show that, even for a relatively small system, this finite time is very 
large, and therefore that mean-field conclusions can be of importance in the real world. 
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APPENDIX: 



We consider the case when the primary minimum of the potential is in the RS region: go = <Zi = <?• Then, for fixed 
T", we compute the value of qi2 and q for this minimum, an d q pr ■ The saddle point equations for qq, qi, x reduce 
to 



pr _ pr 

P 2 n q n = q j^p^ (ad 



2 



and the equation -§^— = is 



The value of the potential is 



pr 

wn&) = ( a 2) 



r„, ,„„„., = - >'iu/;\ > + f /(«r) - §(i - <T)/'(<T) - -^(i -'/" > (Am 



^marj = 7^ + 0F(T)) (A4) 



The energy of the second replica, in this minimum, is 

d_ 

dp' 

which yields 

E prima rv = -l?f((&) + Pf{<T) ~ PfQ) (A5) 

On the other hand, we can write the TAP free energy as: 

f T Ap(H,q,P) =H-±ln(l -q)- - /(«) - (1 - ?)/'(«)), (A6) 

where Q= j? m i > an d ^ ^ s the value taken by the Hamiltonian ff({mj}), so the energy of a TAP state rrij is 

Etap = ^=H- (3(f(l) - f(q) - (1 - g)/'(g)) (A7) 

Then, taking 

= Ep r i mar y + - /(<T) - (1 - <T )/ V), (A8) 

we obtain immediately that 

V pnm ary = f T A P (H pr , q V \ 0) - F RS (T). (A9) 

This means that V pr i mary is the free energy cost of having the second replica in a TAP state with parameter q pr and 
energy E pr i mary at inverse temperature /3. 



[1] D.Sherrington, "Landscape Paradigms in Physics and Biology: Introduction and Overview" preprint :iond-mat/960808£ , to 

appear in Physica D, and references therein. 
[2] For a recent review see E. Marinari, G .Parisi, J .Ruiz-Lorenzo, Numerical Simulations of Spin Glass Systems, cond- 

mat/9701016, contribution to the volume: "Spin Glasses and Random Fields", edited by P. Young. 
[3] D. J. Thouless, P. W. Anderson, and R. G. Palmer, Phil. Mag. 35, 593 (1977). 

[4] D. Thirumalai and T. R. Kirkpatrick, Phys. Rev. B 37 5342 (1988); T. R. Kirkpatrick and P. G. Wolynes, Phys. Rev. B 
36 8552 (1987); D. Thirumalai and T. R. Kirkpatrick, Phys. Rev. B 38, 4881 (1988). 



15 



T. R. Kirkpatrick and D. Thirumalai, Phys. Rev. B 36, 5388 (1987). 

T. R. Kirkpatrick, D. Thirumalai, and P. G. Wolynes, Phys. Rev. A 40, 1045 (1989). 

G. Parisi, II nuovo cimento 16, 939 (1994). 

M. Mezard, G. Parisi, and M. A. Virasoro, Spin Glass Theory and Beyond, World Scientific, Singapore, 1987. 

J. Kurchan, G. Parisi, and M. A. Virasoro, J. Phys. I France 3, 1819 (1993). 

I. Kondor, J. Phys. A 22 L163 (1989); I. Kondor and A. Vegso, J. Phys. A 26 L641 (1993). 

S. Franz and M. Ney-Nifle, J. Phys. A 28 2499 (1995). 

S. Franz and G. Parisi, J. Phys. I (France) 5, 1401 (1995). 

R. Monasson, Phys. Rev. Lett. 75, 2847 (1995). 

S. Franz and G. Parisi, Phase diagram of glassy systems in an external field, condmat 9701033. 
A. Barrat, R. Burioni, and M. Mezard, J. Phys. A 29, L81 (1996). 
L. F. Cugliandolo and J. Kurchan, Phys. Rev. Lett. 71, 173 (1993). 

A. Cavagna, I. Giardina and G. Parisi, Structure of metastable states in spin glasses by means of a three replica potential, 
condmat 9611068. 

A. Crisanti and H.-J. Sommers, J. Phys. I (France) 5, 805 (1995). 
A. Barrat, The p-spin spherical spin glass model, condmat 9701031. 

H. Rieger, Phys. Rev. B 46, 14655 (1992). 

S. Franz and M. Mezard, Physica A 210, 48 (1994). 

A. Houghton, S. Jain, and A. P. Young, Phys. Rev. B 28, 290 (1983). 

H. Horner, Z. Phys. B 66 175 (1987); A. Crisanti, H. Horner and H.J. Sommers, Z. Phys. B 92 257 (1993); E. De Santis, 
G. Parisi and F. Ritort, J. Phys. A: Math. Gen. 28 327 (1995). 

B. Bernu, J.-P. Hansen, Y. Hitawari and G. Pastore, Phys. Rev. A36 4891 (1987). 
J.-L. Barrat, J-N. Roux and J.-P. Hansen, Chem. Phys. 149, 197 (1990). 

J.-P. Hansen and S. Yip, Trans. Theory and Stat. Phys. 24, 1149 (1995). 



D. Lancaster and G. Parisi, A study of activa ted processes in so ft sphere glass, cond-mat 9701045 



G. Parisi, Short time aging in binary glasses, cond-mat 9701015 



cond-mat 9701034 



cond-mat 9701 10C 



G. Parisi, On the mean field approach to glassy systems, 

G. Parisi, Numerical indications for the existence of a thermodynamic transition in binary glasses, 
S. Franz, E. Marinari and G. Parisi, J. Phys. A 28, 5437 (1995). 

F. Ritort, Phys. Rev. Lett. 75, 1190 (1995); S. Franz and F. Ritort, Europhys. Lett. 31, 507 (1996); S. Franz and F. Ritort, 
J. Stat. Phys. 85, 131 (1996). 
[33] J. Kurchan and L. Laloux, J. Phys. A 29, 1929 (1996). 



l(i 



D 



0.025 

0.02 r 

0.015 7 

0.01 7 

0.005 - 




1 



0.05 0.1 0.15 0.2 0.25 0.3 



